DOCUHENT BESURE 



ED 100 351 



16 



IB 001 1149 



AOTHOB 
TTTLF 

INSTITOTIOH 
SPOHS AGFNCT 



P*POFT NO 
POB tATE 
CONTPACT 
NOTE 



Stevens, Kenneth N.; And Others 

Assessment of Nasality in the Speech of Deaf 

Children. 

Bolt, Beranek and Nevnan, Inc«# Caabridge, Mass. 

Bareau of Education for the Handicapped (DHEW/OE) , 

Washington, D.C. Media Services and Captioned Pilts 

Branch. 

BBN-2902 

ia Sep 74 

OEC-0-71-U670 (615) 

53p.; For related documents see IP 001 450 through IB 
001 455 



EDPS PBTCE 
DESCPIPTORS 



TOENTIFISBS 



HP-$0.75 HC-$3.15 PIOS POSTAGE 

Audio Eguipnent; Aurally Handicapped; Computers; 
♦Deaf Children; Deaf Education; Deaf Besearch; 
♦Electromechanical Aids; ♦Handicap Detection; 
Measurement Instruments; ♦Speech Evaluation; ♦Speech 
Handicaps; Speech Instruction; Speech Skills; Visual 
Aids 

Accelerometer ; ♦Nasality; Velar Control 



ABSTPACT 

To improve speech patterns of deaf children, a visual 
aid was developed which assists in the training of velar control. A 
small accelerometer is attached to the nose, and its output presented 
on a computer-controlled visual display. The display then may be used 
as a training aid, or for analysing recorded or live speech. 
Properties of accelerometer output in speech of people with normal 
hearing and children with severely impaired hearing are compared. The 
data show inadequate velar control, particularly improper 
nasalization of certain vowels for a significant number of deaf 
children. Some comments are made on the development of procedures for 
the training of velar control using the display as an aid. (SK) 
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Abstract 

Nasality is widely recognized as a problem in the speech 
Of many deaf people. This paper describes one approach to the 
assessment of that problem and to the development of visual aids 
to assist in the training of velar control. The approach involves 
detection of the velar opening during sounds by means of a small 
acce3erometer attached to the nose, and presentation of the 
acf eleromcter output on a computer-controlled visual display. 
The display may be used as a training aid, or for the purpose of 
analyzing either recorded or live speech. Objective data are 
presented on some of the properties of the accelerometer output 
for the speech of people with normal hearing and of a number of 
children whose hearing is severely impaired. These data show 
inadequate velar control, particularly improper nasalization of 
certain vowels, for a significant number of the deaf children. 
For a group of tho hearing-impaired children, subjective judgments 
of the adequacy of velar control and of other speech attributes 
were obtained. Correlations among these judgments and relations 
between nasality judgments and the objective measures are shown. 
Some comments are made on the development of procedures for the 
training of velar control using the display as an aid. 
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Assessment of Nasality in the Speech 
of Deaf Children 

Kenneth N. Stevens 
Raymond S. Nickerson 
Arthur Boothroyd 
Ann Rollins 

NASALITY AS A PROBLEM IN THE SPEECH OF THE DEAP 
It has long been recognized that one source of difficdlty 
with the speech of many deaf people is inappropri <: t e control of 
the velum. When the velum remains low during a V(...cl sound that 
is normally nonnasal , the resulting acoustic coup: ing between 
mouth and nose cavities can modify the properties of the sound 
and can lead to a subjective impression of nasality. Failure 
to raise the velum during an obstruent consonant (a consonant 
produced v/ith pressure build-up in the mouth) leads to a marked 
change in the properties of the sound during the interval of 
consonantal constriction, and in some cases causes a nasal 
consonant to be generated rather than an obstruent. On the 
other hand, if the velum is not lowered during a nasal consonant, 
pressure can build up in the mouth, and a stop rather than a 
nasal consonant is heard. 

Inadequate or improper control of the velum has usually been 
considered to be the primary cause of the subjective impression 
of nasality (Hudgins, 1934), although some investigators have 
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suggested that the perception of nasality can also be influenced 
by other factors nuch as malarticulation, pitch variations, and 
speech tempo (Colton and Cooker, 1968). The term hypernasality 
is sometimes used to describe the condition where the passage to 
the nasal pharynx is left open when it should be closed; hyponasality 
results if the passage is closed when it should be open. Many 
deaf speakers who have problems with velar control exhibit both 
hyponasality (by producing some nasal consonants with a closed 
velum) and hypernasality (by producing some vowels and nonnasal 
consonants with a lowered velum) . 

In spite of the fact that the problem of nasality has been 
widely acknowledged for many years — Brehm (1922) referred to it 
as "the nightmare of all speech teachers" — it remains a difficult 
one to diagnose and remedy for two reasons. First, nasality is 
apparently a difficult quality to judge by ear. The difficulty 
is due in part perhaps to the fact that distinctive perceptual 
features of nasality are not clearly defined, and in part to the 
fact that the overall quality of speech is affected by many 
factors that may interact with nasality in complex ways. 
Subjective judgments of hypernasality in a deaf child's speech 
are complicated by the fact that the expression "nasal speech" 
may include more than one type of deviation from normality. For 
example, a deliberate constriction of the nasal pathways modifies 
the resonant characteristics of nasal consonants and adjacent 
vowels to produce a type of "nasal speech" which does not 
necessarily involve improper velar control. 
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A second reason for difficulty in the diagnosis and 
remediation of nasality is that the articulatory gesture involved 
in closing and opening the passage to the nasal cavity (raising 
and lowering the velum) is not visible, and such proprioceptive 
cues as exist do not seem to be cognitively meaningful. The 
deaf child who must use lipreading as his primary speech input 
does not receive information on the state of the velum. Hyper- 
nasal vowels are visually indistinguishable from nonnasal vowels, 
just as the plosives /b/, /d/, and /g/ are visually indistinguish- 
able from the nasal consonants /m/, /n/, and /n/. Even the 
deaf child with usable residual hearing typically cannot 
discriminate auditorily between nasalized and nonnasalizcd vowels. 
This problem is further complicated by the fact that in the 
environment of a school for the deaf, or even among family and 
friends, the deaf child's own speech is understood partly on the 
basis of its visual features rather than its auditory ones. 
Thus, the absence of appropriate velar control may not prevent 
the child from being understood, and a powerful motivator for 
acquisition of this skill is missing. 

Both of these factors— the difficulty of detecting nasality 
auditorily and the lack of natural nonauditory cues to aid the 
child in learning to make appropriate use of the velum — demonstrate 
the need for the development of reliable, practical, and objective 
methods for measuring and representing the nasality of speech. 
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The purpose of this paper is to describe one approach to 
this problem. First, we describe a method of detecting and 
displaying nasality information; second, we present some nasality 
data that have been obtained from both deaf and hearing speakers. 
The procedure for detecting and displaying nasality information 
is currently being used in an experin^ _al system of speech-training 
aids for the deaf (Nickerson and Stcvons, 1973). Training 
procedures that utilize the displays are still being evolved. 

The method for detecting nasality is not, of course, restricted 
to the speech of the deaf. Of particular interest is the potential 
application of the method to the evaluation of nasality in the 
speech of individuals with cleft palate. 

DETECTION AND DISPLAY OF NASALITY 
Nasality is difficult to detect from direct measurements on 
the speech signal. Several acoustic correlates of nasality in 
vowels for adult speakers have been investigated, among them 
shifted and "spli " first formant (Fujimura, 1960; House and 
Stevens, 1956), and enhanced amplitude of the lowest harmonics 
(Delattrc, 1955). These acoustic attributes are rather subtle, 
however, and the particular way in which nasality is manifested 
in the acoustic signal varies from vowel to vowel. 

Several methods of measuring nasality by other means have 
been proposed. These methods detect the flow of air through the 
nose (Lubker and Moll, 1965; Quigley, et al., 1964), they measure 
the acoustic energy radiated from the nostrils (Fletcher, 1970; 
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Shclton, et al., 1967), or they pick up the vibration on the 
surface of the nose (Holbrook and Cr£iwfox*d, 1970). The procedure 
employed in this study uses the last of these methods. The 
vibration is transduced by moans of a small accelerometer 
attached to the surface of the nose (Stevens, Kalikow, and 
Willemain, 1974). The accelerometer weighs just 1.8 gms, and, 
as Figure 1 shows, in very small. It has a negligible distracting 
influence on the speaker, and presumably does not affect her speech. 

When the velum is lowered during a voiced sound, the increased 
sound energy in the nasal passages causes vibration of the nose and 
an increased output of the accelerometer. This output is rectified, 
low -pass-filtered (averaging time of about 20 msec), sampled (at 
10-msec. intervals), log-converted, and displayed on an oncilloscopG 
as a time function. 

An example of this time function for a phrase produced by a 
normal male speaker is shown in Figure 2. The phrase is "You can 
drink your milk." The nasal output for the first (nonnasal) vowel 
is about 20 dB below the peaks that occur during the nasal 
consonants. Vowels preceding nasal consonants (/as/ in can and 
/x/ in drink) are nasalized, as expected, and nasalization even 
extends across word boundaries, as in the word J^our, which precedes 
the /m/ in milk without an intervening obstruent consonant.^ 
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Fig. 1. Accelerometer attached to nose of subject. Also shown is 
' a small microplionc used for transducing the acoustic 

signal. Tlie accelerometer-microphono arrangement provides 
input signals to a system of speech- training aids. 
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I'^ig. 2. Display of amplitude of output of nose accelerometer as 
a function of time for the sentence, "You can drink your 
milk," produced by a normal adult male speaker. The five 
syllables in the sentence are identified above the display. 
See text. 
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NASALITY MEASUUi:Mi:KTS FOR NORMAL. SPEAKERS 

Vowels 

As Figure 2 shows, the nan^l accclcromoter gives some output 

during nonnasal vowels, although this output is well below that 

for nasal consonants and nasalized vowels. In order to obtain 

data on the degree to which the accelcromoter output can be used 

to discriminate nasal from nonnasal sounds, a number of measurements 

of the accclerometer signal have been made for normal-hearing 

children (n = 17, ages 8-15) and adults (11 male, 13 female) 

producing monosyllabic words containing no nasal consonants and 

words with nasal consonants. The nonnasal words wore selected 

to include a range of nondiphthongizcd vowels, while the nasal 

words included nasal consonants in both initial and final position. 

2 

The list of wordr. for which measurements were obtained is given 
in Table 1. 

Measurements of the peak output of the accelerometer were 
made, using the computer display in conjunction with a procedure 
that permitted the observer to adjust a cursor and to obtain a 
numerical value of the output directly from the display. Examples 
of the display used in making these measurements for a nasal word 
and for a nonnasal word are shown in Figure 3. In each case, the 
cursor is adjusted to a point where a peak occurs in the accelerometer 
output. For a nonnasal word, the peak occurs during the vowel, 
whereas for a nasal word the peak is in the nasal consonant. The 
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Table 1. List of words recorded by normal-hearing subjects 
and by deaf children. 



leaf 

dish 

dress 

flag 

socks 

glove 

straw 

church 

book 

shoe 



Vowel 

X 

z 



A 

D 

V 

u 



Na s a 1 _Woi^d s 
mouth 
nail 
arm 
spoon 
queen 
clown 
ring 
snow 
jump 
hand 
think 
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Fig. 3. Nasality display for the words "mouth" (left) and "socks" 
i (right) . Peak recordings of accelerometer output (in 

u'-.its of 0,1 dB) are shown above oacli contour. The numbers 
below the curves indicate the locations of time samples 
(in units of 10 msec.) where readings were obtained. 
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numerical amplitude values indicated on the display at the position 
of tho cursor are in units oi about 1/10 dB. For purposes of 
discussion, we shall use the term "peak nasality" to indicate the 
peak value of the acceleromoter output obtained by this procedure. 

The peak nasality for the words with nasal consonants showed 
some variability from one utterance to another, presumably caused 
by fluctuations in voice level of the speaker and by differences 
in the place of articulation of the nasal consonant and the position 
of the consonant in the word. The standard deviation in these 
readings for nasal consonants for a given speaker was 1-3 dB, 
depending on the speaker. On the average, the peak nasality for 
the nasal consonant /m/ was 1-2 dB below the value for /n/ and /n/. 
The peak nasality for final nasal clusters was 1-2 dB below that 
for initial or final singleton nasals. An average reading of peak 
nasality over all nasal words in Table 1 was calculated for each 
speaker. 

The peak nasality in the vowels for nonnasal words depended 
to some extent on the vowel. For each speaker, the difference 
between the average over nasal words and the peak nasality for each 
nonnasal word was calculated. (In tho example in Figure 3, the 
difference in peak nasality for the nasal consonant and the non- 
nasal vowel is 182 units, or about 18 dB.) These differences, 
averaged over the 17 children are shown for each vowel in Figure 4. 
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Fig. 4. Average difference between peak nasality for (1) 

monosyllabic words containing nasal consonants, and 
(2) nonnasal monosyllabic v;ords. The vov/els forming 
the syllabic nuclei for the nonnasal words are shovm 
on the abscissa. Averages for 17 normal-hearing 
cliildrcn. Vertical bars indicate standard deviations 
across speakers. 
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The vowel /i/ clearly show:3 tho least difference in nasality 
reading compared with nasal words — a difforoncc of about 11 dU, 
on tho average. The other high vov.'cl /u/ has a difference of about 
14 dB. For non-high vowels, the difference is greater, and is 
about 20 dB, on the average. As shovm by the vertical bars around 
each point, which indicates standard deviations across speakers, 
there are considerable differences in the nasality readings from one 
individual to another. These are presumably due to fluctuations in 
voice level, anatomical differences, and speaking habits. 

Data for adult males, adult females and children are compared 
in Figure 5. The curves show the same general trends as the data 
in Figure 4. Differences between men, women and children are not 
large, although there is a tendency for the data for. children to 
be slightly above those for men and women, at least for some vowels. 
This difference can presumably be ascribed to the higher average 
fundamental frequency and formant frequencies for children. The 
standard deviations for adult speakers are roughly the same as those 
for children. 
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VOWEL 

Fig. 5. Same as Fig. 4, except average data are compared for 

three normal-hearing groups: adult males (11 speakers), 
adult females (13 spea}cers) , and children (17 speakers) . 
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The cUffcrcnccr, in nasality readings from one vowel to another, 
shown in Figures 4 and 5, could have been the result of the influence 
of the initial or final consonant rather than being an inherent 
property of the vowel, since different consonants occurred in the 
words with different vowel nuclei. In order to examine this 
possibili'iy, a set of monosyllabic nasal words and words containing 
different vowels in context hVd was recorded for a subset of the 
adults and children used to collect the data in Figure 5. The nasal 
accelerometer output was processed in the same way as indicated 
above, to obtain difference readings for the nonnasal vowels 
relative to the nasal consonants. The data for the vowels in the 
hVd context were almost identical to those for the words in 
Table 1 with the random consonantal contexts, indicating that the 
results of Figuir^^s 4 and 5 represent inherent properties of the 
individual vowel nuclei, and are not greatly influenced by 
consonantal context. 

The signal that reaches the accelerometer is probably the 
result of excitation of the tissue of the nose by sound energy 
in the nasal cavity (although the possibility that some of the 
energy is structure-borne through the maxilla cannot be ruled out), 
sound energy reaches the nasal cavity either by passing through a 
partially open velopharyngeal port, or through the palatal structure 
if there is no velar opening. In either case, one would expect 
the acceleration amplitude on the nose surface to be greater at 
low frequencies than at high frequencies. Thus, it is not 
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unexpected that the peak ncisality reading is greater for vowels 

3 

with low f irst-formant frequencies (i.e., /i/ and /u/) . 

The data in Figures 4 and 5 provide some indication of the 
differences between nasality readings for nasal and nonnasal sounds 
in monosyllabic words generated by normal speakers. If a display 
of the amplitude of the acccloromGter output is used in a speech- 
training situation with deaf children, these data can serve as a 
guide for specifying the nasality readings that should be achieved 
for different vowels. The procedure would be to obtain first 
a baseline nasality reading for a nasal consonant, and then require 
that the reading for a given nonnasal vowel be less than this 

baseline reading by the amounts suggested by Figures 4 and 5 
(assuming the speech level does not change appreciably, as discussed 
in Footnote 1 ) . 

Nasal_Consonarits_in Context 

Ability to produce steady vov;els (or vowels in nonnasal CVC 
words) within proper limits of nasality does not, of course, 
guarantee that an individual can exercise proper velar control 
in more complicated phonetic environments. When an utterance 
of several syllables contains one or more nasal consonants, 
there is a requirement that the velum be raised and lowered 
in proper synchrony with the movements of other articulatory 
structures. When a nasal consonant is preceded and followed by 
vowels or by sonorant consonants (consonants produced with no 
pressure build-up in the mouth) , the velum can remain open for 
some tens of milliseconds before and after the nasal consonant. 

17 
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That is, the jnovemcnts of the velum can he rather sluggish. The 
presence of an obstruent consonant, however, requires that the 
velum bo closed, since pressure must be built up in the mouth. 

The spread of nasality into vowels adjacent to a nasal 
consonant is illustrated in Figure 6. The sentence "We were in 
Europe" contains one nasal consonant with several non-obstruent 
sounds precodiag and following the consonant. As the nasality 
display demonstrates, there is a broad peak in the acceleromoter 
output, extending over about 260 msec, (indicated by the positions 
of the two cursors) . Also shown in the figure is a display of the 
"amplitude" of the speech signal,^ and a spectrogram of the 
utterance, on which the cursor positions are marked. The region 
of tongue constriction for the nasal consonant (of duration about 
90 msec.) can be easily observed (arrows above the spectrogram). 
Evidence of nasality in the vowels adjacent to the consonant can 
be seen in the spectrogram, particularly (in the preceding vowel) 
the split first formant that is characteristic of nasalized vowels. 
The peak in nasality occurs at a dip in the amplitude of the speech 
signal between two syllabic nuclei, as would be expected. In 
contrast to the nasality display in Figure 6 is the contour for 
the sentence "We were in Greece," shown in Figure 7. In this 
case, there is an abrupt drop in nasality following the /n/, since 
the velum must be closed to permit pressure build-up for the /g/. 
(The drop in nasality shown in the figure is slower than the actual 
drop, since there is some smoothing in the nasality d.isplay . ) 
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I'ig. 7. Display of nasal accelerometer output for the sentence 
"v;e were in Greece." 
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Other examples illustrating the dynamics of velar control are 
shown in Figures 8 and 9. In Figure 3, the nasality and amplitude 
displays are given for the contras ing utterances "type out" and 
"time out. " The nasalization in both vowels of the latter utterance 
(particularly the vowel preceding the nasal consonant) is apparent, 
whereas both vowels in the first utterance are nonnasal. Figure 
9 shows the nasality display for the three words "cinder, sinner, 
sitter." Tliere is an abrupt drop in nasality following the /n/ in 
the first word, with a nonnasal second syllable. Both syllables 
are nasalized in the second word, whereas both are nonnasal in the 
third word. 
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^ig. 8. Amplitude (top) and nasality displays for the utterances 
"type out" and "time out." The cursor is positioned 
at the nasality peak (coinciding with the amplitude 
minimum between vowels) in the second utterance. 
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NASALITY IN THE SPEECH OF DEAF SPEAKERS 
-^^1*12.^ ^ ^"ilSLH Nasa 11 __o f _D g a f _C h i 1 d r o n _f o r _Wo r d c 

As part of an effort to deveiop and test* certain speech-training 
procedures that make use of a computer-based system of speech-training 
aids, recordings of speech were obtained from a number of deaf 
students. For one group of 25 students, recordings of the list of 
monosyllabic words shown in Table 1 v;ere obtained in one session, 
and a series of objective measurements was made from the recordings, 
following procedures used in obtaining data for normal speakers, 
as discussed above. For each of the words in Table 1, the "peak 
nasality" was measured during the nasal consonant in the case of 
words containing nasal consonants, and during the vowel in the 
case of nonnasal words. There were, of course, many examples in 

which a stop consonant was substituted for a nasal consonant (i.e., 
hyponasality occurred) , and the peak nasality during the consonant 
was significantly lower than it should have been. In a number of 
utterances with no nasal consonants, the nasality reading in the 
vowel v;as abnormally high. For all children, there were at least 
some nasal consonants in some words that were produced with a 
relatively large nasality reading, and which were judged by 
listeners to be adequate versions of nasal consonants. Average 
readings of peak nasality for these words were obtained for each 
of the deaf children. These averages provided reference nasality 
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readings; they correspond to the average readings over all nasal 
words that were obtained for normal ppeakcrs, as discussed above. 
Words containing nasal consonants that were not adequately nasalized 
were noted. The peak nasality was then measured for each of the 
i.onnasal words, and these values wore subtracted from the reference 
nasality readings for each speaker. Thus, for each word (and 
hence for each vowel, since the words were selected to contain one 
token of each vowel, as indicated in Table 1), a difference 
measure was obtained similar to the measures for normal speakers, 
shown in Figures 4 and 5. 

The adequacy of velar control for the words containing nasal 
consonants was assessed for initial nasals, final nasals, and 
nasal clusters in final position. The data are summarized in 
Table 2. (The woL^d snow was omitted from this summary. The 
nasal consonant in this word was, in fact, rarely denasalized . ) 
Not unexpectedly, the children had the greatest problem in 
properly nasalizing the nasals in words with nasal-stop clusters. 
Generation of these words requires a velar opening-closing 
movement that iy closely coordinated with the movements of the 
supraglottal articulators. About half of the children studied 
made a nasality error on at least one such word, and 12% made 
an error on all three of these words. Table 2 also shows that 
initial nasal consonants were produced with hyponasality more 
frequently than were final nasals. 
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Tabic 2. Percent of nasal con5:,onant.n in each clans which v;cro 

denasalizod or inadequately nasalized by deaf children, 



Percent 
Denasalized 



initial nasals (nail, etc.) 16 
final nasals (clown, etc.) 8 
nasal clusters (jump, etc.) 36 
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Using the difference nasality moaGure noted above, each 
vowel in a nonnasal word was assessed for the adequacy of its 
nasal characteristics. The following criterion was used: if the 
difference measure for a vowel produced by a deaf child was more 
than one standard deviation below the curve shown in Fiqure 4 
(i.e., below the lower end of the vertical bar), the vowel was 
considered to be improperly nasalized. The number of ;uch hypernasal 
vowels was determined for each student, and the results are 
summarized in Figure 10 as a cum.ulative plot. The figure shows 
that 761 of the students examined had excessive nasality in at 
least half of the vowels in monosyllabic words. Thirty-six percent 
of the students had excessive nasality in at least eight out of 
the ten vowels studied. 

The criterion for "excessive nasality" is, perhaps, rather 
severe, since some normal speakers would be judged to have nasal 
vowels by this criterion. The number of normals wlio do not meet 
this criterion is also shown in Figure 10, with adults and 
children being represented separately. The number of normals who 
would be judged to have excessive nasality (by the specified 
criterion) in more than two vowels is small. 

The population of deaf students on v;hich the data in Table 2 
and Figure 6 are based was not necessarily selected to be 
representative of deaf students in general. The age range was 
8 to 16 years, the numbers of girls and boys were about equal, 
all the children were from the Clarke School for the Deaf, and the 
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Fig. 10. Incidence of errors in nasality for nonnafsal vov/els 
produced in monosyllabic words by deaf children (D) , 
hearing children (C) , and hearing adults (A) . Data 
based on objective measurements of nasality in ten 
different nondiphthongized vov;g1s. Criterion for error 
in nasality is defined in text. 
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general speech intelligibility covered a broad range from 13 percent 
to 8G percent (ix;;-,od on number of words in sentences identified 
correctly by listeners). In view of the widely differing kinds of 
speech problems of deaf child>:en and the variety of approaches 
to the speech training of such children, a sample of 25-odd 
students from one school could not be expected to be sufficient 
to represent the general population of deaf students. 

c {!.5.L^e _n a t a _f r om _S i^ den t s 
A more extensive set of speech material from six of the 25 
students was recorded on two occasions--once before a series of 
experimental training procedures was begun, and once at the end 
of training. The recordings were analyzed by a set of objective 
procedures, and were also subjected to listener evaluations. 
In addition to the list of monosyllabic v:ords recorded by the 
normal-hearing speakers (of v;hich Table 1 forms a subset) , the 
speech materials that wore generated by this group included a list 
of 24 read phrases and sentences, and spontaneous speech produced 
in the description of picture sequences. Since these materials 
were recorded as part of a larger study, only some of the utterances 
were designed specitically to examine problems of velar control. 
The phrases and sentences that were studied particularly from the 
point of view of velar control are listed in Table 3. The first of 
these items has no nasals, the second and third have a number of 
nasal consonants with no intervening obstruent consonants, and 
items 4, 5, and 6 contain mixed stops and nasals. 
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Table 3. List of phroKOs and scntonces that were examined lor 

adequacy of velar control when produced by deaf children. 

1. You lost your glove? 

2 . My money . 

3. Many men are in Maine now. 
' 4. You can drink your milk. 

5. I went home Friday night. 

6. A spoon and a dish. 
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The six studcnti-'. who rocorded thin more GXtcjisivc matcria.l 
wei'c selected for speech training because they had specific speech 
problems that required attention, and it was thought that the 
speech- training procedures that might be employed in the remedi- 
ation of these problems could be assisted by using the computer- 
based system of displays. Five of the six students wore diagnosed 
as having some problems with velar control. 

Two types of listener evaluations were obtained from 
the material recorded by these six students. Four experienced 
listeners (teachers of the deaf) evaluated the recordings 
with respect to specific articulatory and suprasegmental 
aspects of the speech. Formal worksheets specified for each 
utterance the type of evaluation that was to be made. 
For fcxampie, the phrase "a spoon and a dish" was judged 
with respect to harshness, breathiness, average pitch, pitch 
range, intonation, rate of utterance, pause placement, and 
stress placement. Items 1-5 in Table 3 were judged with respect 
to adequacy of velar control. For each item the judgment v;as 
made on a five-point scale, the end points of which v;ere defined 
as "no problem" and "serious problem." Words spoken in isolation 
were evaluated in terms of initial sound{s), vowel nucleus, and 
final sound (s), or a specified subset of these components. 
Similar judgments on individual speech sounds were made for some 
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of the words in the phrases and sentences. Listeners were 
permitted to listen to each utterance as many times as they 
wished before making their judgiaonts. Table 4 lists the types 
of judgments that were made. Not all types of judgments were 
made on all utterances, although, in many cases, several types 
of judgments were made on a single utterance. 

The same four experienced listeners plus eight "naive listeners" 
(listeners who had had little or no prior exposure to speech of the 
deaf) were used for intelligibility testing. The speech material 
in this case was taken from the sentences that are used by the 
Clarke School for the Deaf in its regular intelligibility testing 
program (Magner, 1972). The same groups also listened to the 
spontaneous speech in which the children described picture sequences. 
An intelligibility measure based on the number of "content" words 
heard correctly was determined for each listener group. Inasmuch 
as two of the experienced listeners had each tutored three of the 
children whose speecJi was being evaluated, tl^e intelligibility data 
obtained from a tutor on the speech of a child that he had taught 
was not included in the analysis. 
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Tabic 4. List of attributos for which jucUjinents were obtained 
from speech material con;jii.->t ;.ncr of words and phrasos. 
The nunibor.<5 at the riylit indicate correlation coefficients 
(Peartion i-'i;) wlien scores from judgments of adequacy of 
velar control (in certain of the phrases and sentenccf^) 
were compared with scores from all other types of 
judgments . 

Overall adequacy of vowel articulation 0.30 

Overall adequacy of consonant articulation 0.72 

Overall adequacy of consonant blonds 0.41 
Consonant production: 

Initial consonants 0.75 

Final consonants 0.65 

Consonants in words 0.71 

Consonants in sentences 0.71 

Voiceless consonants 0.74 

Voiced consonants 0.64 

Plosive consonants 0.75 

Fricative consonants 0.67 

Vowel-like consonants 0.54 

Nasal consonants 0.57 
Judgments of voice quality: 

Harshness 0.22 

Breathiness -0.08 

Composite quality 0.07 
Pitch control: 

Mean pitch 0.54 

pitch range 0.49 

Intonation 0.33 

Composite pitch 0.46 
Temporal features and stress: 

Rate 0.37 

Phrasing (pauses) 0.37 

Stress 0.34 

Composite 0.37 

Velar Control 1.0 
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In addition to listener judgments, acoustic data were obtained 
from the recorded speech samples. These data included the 
measurements of nasality for words in isolation (which were included 
in the data for the larger cample of children as described above) , 
together with measurements of nasality for the phrases listed in 
Table 3, following procedures to be described below. 

?i?.I^ti9^1._^2^tween _Jud god^ ]i9.£_Contr ol and Other 

lli.^.t^ll^I." ^Y.^l^'i'^ ted Fea tu r o s 

As part of the analysis of the listener- judgment data, two 
composite scores, were obtained for each of the six students and 
each of the variables listed in Table 4, one for the speech sample 
recorded before training and one for that recorded after training. 
Each composite score was derived by pooling the judgments of the 
four listeners. Thus, for each of the attributes listed in Table 
A, a set of twelve scores was derived. Correlation coefficients 
(Pearson r's) were obtained for all pairwise comparisons of these 
sets of scores. 

The results of this analysis must be interpreted with caution 
because of the small samples involved; however, they are suggestive 
of directions future work might take. Hudgins (1949) has pointed 
out the desirability of taking advantage of correlations that may 
exist between different speech features because of the impracticality 
of measuring everything. 
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Inasmuch as nasality ir. often thought of as a "quality" 
deviation, or suprascgmcntal asipect of Fpccch, that is relatively 
independent of problems associated with the articulation of 
individual speech sounds, the corrclationn between judgments of 
adequacy of volar control and the other variables listed in Table 
4 are somewhat surprising. Nine of a total of 2 4 coefficients 
were significantly different from 0 (p < .05). All of these nine 
involved segrental features and in particular the articulation of 
consonants; consonant articulation in general (r = .72); 
articulation of consonants — in initial position of word (r = .75), 
in final position of word (r = ,65), in isolated word context 
(r = .71), in sentence context (r = .71); articulation of voiceless 
consonants (r ~ .74), of voiced consonants (r = .64), of plosives 
(r = .75), and of fricatives (r = .67). The other tv/o coefficients 
involving consonant articulation — vov;el-like consonants (r = .55) 
and nasal consonants (r = .57) — were also relatively large, but 
not quite statistically significant. The correlations between the 
velar control judgment and suprasegmental features tended to be 
considerably smaller (.32 on the average). Perhaps most surprising 
of all is the fact that the correlation between the subjective 
assessment of velar control and overall voice quality was .07. 
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A possible explanation for the relatively high corrolationn 

between judged adequacy of volar control and articulation of 

* 

obstruent consonants is tiiat tho production of obstruents rccjuires 
pressure build-up in the mouth, and thus a raised velum (as 
discussed earlier). Inappropriate dynamic control of the velum 
for obstruent consonants could rf=?sult in a lack of pressure 
increase, and hence an impression of poorly articulated consonants 
as well as of general nasal quality. 

Judgments of velar control were also correlated with four 
measures of intelligibility representing the four possible 
combinations of naive and experienced listeners and read and 
spontaneous speech. In general, the coefficients were larger for 
experienced than for naive listeners (mean r's of .63 and .41), 
and for read than for spontaneous speech (mean r's of .61 and .43). 
However, only the coefficient representing the correlatioji bf^tv;cen 
judged adequacy of velar control and the intelligibility of read 
speech as listened to by experienced listeners was statistically 
significant (r = .74). 

Any inferences about the relationship betv;een nasality — or 

any other property of the speech of the deaf— and intelligibility 

that are based on intelligibility data obtained in the laboratory 

inust be made with care. The experience and expectations of a 

■I 

listener can have a large influence on his ability to understand 
the speech of a deaf person (Adams, 1914). 
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5^l9.t!i9.!l _t9— •l^iSi9Ji^} lVt-I_^f J^J^^ u_n c y _o f _Ve 1 a r Control 

Measuromcnts of the dcgr^-'O of nwisality of isolated speech 
soundr., or of specific sounds within words spoken in isolation, 
represent one type of objective data that can be useful in evaluating 
speech. One woulO. like in addition, however, Forae measure or 
measures that can be used to represent the adequacy, vis-a-vis 
nasality, of an entire meaningful utterance. As discussed above in 
connection with Figures 6 and 7 for normal-hearing speakers, the 
control of the velum within an utterance requires that the speaker 
lower the velum during conr.onantal cloGure interval for nasal 
consonants and raise the velum at all other times. A normal speaker 
also employs a certain amount of anticii^atory and posticipa tory 
coarticulation in velar control. Thus a vowel between two na.-^al 
consonants is usually produced with a lov/ered or partially lowered 
velum; when a nasal consonant is surrounded by sequences of nonnasal 
sonorants, the lowering of the velum anticipates the nasal consonant 
by 100 msec, or more, and thcrn is a similar carryover of nasality 
following the na^-.T consonant; an obstruent consonant adjacent to 
a nasal requires rapid adjustment of the velum consonant with the 
requirements of the two segments. 
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These rules must presumably be learnod by a deaf speaker if 
he is to produce fluent speech. Some of the problems experienced 
by the deaf children in exercising the«o kinds of velar control 
in a phrase or sentences arc illustrated in Figure 11 » The nasality 
display for a normal speaker producing the same phrase or sentence 
is shown for comparison in each case. In parts (a) and (b) of 
the figure (representing utterances from the same student) , several 
problems are apparent: some vowels are nasalized when they should 
not be (you, yqur) , and some nasal consonants are erroneously 
produced with the velum closed (drink, milk, money). The student 
who produced the displc^y in part (c) apparently lowered the velum 
for all vowels, although she was able to raise the velum to produce 
obstruent consonants (e.g., the /d/ in i'riday) . 

In an attempt to gain objective measures of the adequacy 
of velar control within such longer utterances, all of the 
phrases and sentences in Table 3 recorded by the six deaf 
children v;ere examined and measured jith the computer display. 
Three kinds of phrases and sentence are included v;ithin this 
speech sample: A: sentences with no nasals, B: sentences with 
many nasal consonants and no nonnasal obstruent consonant; and 
C: sentences with mixed n.vsal and nonnasal consonants. Two 
measures of adequacy of velar control have been determined from 
these sentences: 
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(a) YOU CAN DRINK YOUR MILK 




C/7 



1 sec 




N 




TB 



(b) MY MONEY 



1 sec 



40 



dB 



20 



0"- 







H 




O- 


P 0 









JS 



AR L 

(c) I WENT HOME FRIDAY NIGHT 




I sec 



Fig* 11. Examples of output of nasal accelerome ter vs. time for 
sentences produced by deaf students (left) and normal- 
hearing adult female (right) . The positions of the 
vowel nuclei in the various syllables are identified 
by th(^ numbers. 



Report No. 2902 



Bolt Beranek and Newman Inc. 



- (average nasality reading for nasal consonants in 

Type B sentences) - (average nasality reading for vowels 
in Type A sentences) . 
N2 = (peak nasality reading for nasal consonants in Type C 
sentences) - (nasality reading for a nonnasal vowel in 
same sentence) . 

Both and *»^«^^ intended to indicate hov; well a speaker 
discriminates nasals from nonnasal vowels in sentence material: 

compares two types of sentences, and examines velar control 
within a sentence. Since the nasality readings are on a 
logarithmic scale, and are independent of the speech level. 
For normal speakers, and would be in the range 10-20 du. 
(See Figure 2 for an example of a sentence where for a normal 
speaker is about 20 dB.) Values of and close to zero would 
suggest a failure to differentiate nasal and nonnasal sounds. 
These measures could even become negative for a severely 
hypernasal individual who also fails to nasalize some nasal 
consonants. 

The measure does not avoid the problem mentioned in Footnote 
1 above, namely that nasality can vary with voice effort; v;e are 
assuming that the voice effort would have been unlikely to vary 
much from utterance to utterance inasmuch as they were recorded 
at one sitting and within a short period of time. Another problem 
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is that somctimcr. considornblG judcjniont must be exercised in 
deciding what to measure; if the art icuI:ition is very poor, 
syllables may bo missing, spurious Gounds may occur, or it may be 
difficult to determine from listening what constitutes a syllable. 
In the speech samples used there were relatively few cases 
of uncertainties of this sort that could not be resolved by 
listening several times to a difficult segment. 

Measure was obtained for sentences 2 and 3 (all nasals) 
in Table 3, and sentence 1 (no nasals). Measure N2 was 
obtained for sentences 4 (you) , 5 (Fri) , and 6 (dish) , whore 
the syllables in parentheses are the nonnasal syllables that 
were measured. 

T'A/o values of the indices N^^ and ^2 were computed in this 
way for each cliild , one based on the before -training and one 
on the after-training speech sample. These indices v;cre then 

correlated with the velar control judgments made by listeners. 
The correlation (Pearson r) was 0.7 6 for N^^ , 0.69 for N2 , and 
0.78 for the mean (N^^ + N2)/2. The scatter plot for the combined 
measure {n^ + ^2^^^ shown in Fiyur^^ 12, The listener judgments 
are ad -us ted to lie on a scale from 0 (severe problem) to 
5 (no problem) . Given the size of the sample and the crudeness 
of the objective measure, we consider the result to be encouraging. 
One might hope, with some additional work, to define objective 
measures of the nasality of speech that would at least be a 
useful supplement to listener judgments, and might possibly 
obviate them. 
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RATING OF ADEQUACY OF VELAR CONTROL 

Fig. 12. The relation between nasality as indicated by objective 
measurements and adequacy of velar control as judged 
by listeners. The objective measure is c" ffcrcnce 
between accelerometer output for nasals and for nonnasal 
vowels in sentences (see te;:t) . Data for six hearing- 
impaired students, each recorded on tv;o occasions. 
The line is fitted by eye. 
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USE OF NASALITY DISPLAY FOR TRAINIKG OP VELAR CONTROL 

A display of natality versus* time ban been used as an aid 
for training of velar control for several deaf students. The 
details of the display and the general manner in which it is used 
by the teacher and student are described elsewhere (Nickerson and 
Stevens, 1973; Nickerson, et al,, 1974). The following featurer 
of the system should bo noted, liowever; (1) To assist in the 
training of velar control, the nasality display (of the typo 
shown in Figure 2) is combined with an indication of voicing, so 
that wheneve' the utterance is voiced, a horizontal line appears 
at the base of the nasality display. (2) A criterion lino can be 
displayed along with the nasality curve, to indicate to the student 
a particular nasality value that he should attempt to keep below 
(fo;;: a nonnasal utterance) or above (for a nasal consonant) . The 
position of this line can bo adjusted by the teacher (or student) . 
(3) A reference display can be generated by the teacher, and this 
display remains stationary on the upper half of the screen when 
the student attempts an utterance. (4) The displayed curve moves 
from right to left in real time, the current instant of time 
being represented by a fixed location at the right of the screen. 
(5) The past two seconds of the display can be frozen on the screen 
by depressing a button, and this stored display can be replayed, 
together with the audio speech signal. (6) Presentation of the 
display can be simultaneous with the utterance, or can be delayed 
until the teacher (or student) wishes to see it. The delay feature 



Report N'o. 2902 



Bolt Bcranek and Newman Inc 



allows the .student to assess the adequacy of his utterance, based 
on proprioceptive <?uef5 ,^ before xer,ifYincj this judgment with tJio 
visual display. 

Various approaches to the training of velar control arc being 
attempted, depending on the nature of the student's speech problem, 
his age, and his response to the training. Among the vocalizations 
or other utterances that are being used as training materials 
are the following: (1) A long steady vowel with nasality reading 
below a specified criterion, as determined from Figure 4. (2) 
Simple monosyllabic consonant-vowel (CV) or CVC utterances with 
nasality readings within specified criteria. The utterances 
include nonnasal words, words in which both consonants are nasals, 
and words with one nasal consonant and one obstruent consonant. 
(3) Words containing nasal-obstruent clusters, such as iump , 

think. (4) Phrases or sentences containing no nasal 
consonants. (5) Phrases or sentences in which both nasals and 
other consonant types are included. 

For most students, the training is carried out on a tutorial 
basis in a series of sessions with a teacher present. After an 
initial period of orientation and training, some students are 
able to work on a self-tutoring basis without the teacher present. 
Data are being collected to assess the progress of students who 
are being trained by these procedures. The results of that 
evaluation and a more detailed discussion of the training procedures 
will be presented in a future report. 
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NOTKS 



1. One or the problems assoeiatcd with dovoloping meanurcs, 
either of overall nasality or of changes in volar opening as a 
function of time, is the fact that the nasality function is not 
independent of the intensity of the speech. One way to accommodate 
this fact would be to develop a measure that relates the amount 
of energy that is detected by the nose accelerometer with the 
amount that is picked up by the voice microphone. This is not an 
entirely straightforward comparison, however, inasmuch as the 
speech amplitude varies considerably with different speech sounds, 
and in particular tends often to decrease during the production 
of a properly nasalized sound. The problem is not serious as 
long as the speaker maintains a reasonably constant voice effort. 
Variations in level due to changes in voice effort (including 
changes in stress) are not likely to be more than about + 2 dB 
under normal circumstances, whereas changes in the output of the 
nasal accelerometer due to velar opening and closing are in 
the range 10-20 dB. 

Z. This list is part of a longer list of words containing a 
variety of vowels, consonants, and consonant clusters. The items 
in Table 1 represent only the nondiphthongized nonnasal vowels 
and the nasal consonants and consonant clusters. 
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3. hnolUcr possibility is tliat normal spoa);crr, actually proauco 
higli vovols x.'it}i a lower velum and hence witli greater acoustic 
couplinc] to the nasal cavity through the partially open velo- 
pharyngeal port. They may use thin strategy either hecau^^o the 
perceptual effect of increased nasal coupling is less for high 
vowels than for nonhigh vowels or because of interaction between 
muscle groups controlling velar opening and those controlling 
tongue position. Perceptual studies suggest, however, that the 
explanation in terms of the influence of nasal coupling on 
perception of nasality is not valid (House and Stevens, 1956), 
since a given degree of opening of the velopharyngeal port 
appears to make high vowels sound more nasal than low vowels. 

4. The procedure for detecting "amplitude" involves sumn^inq 
the rectified and smoothed outputs of a series of band-pass 
filters (with center frequencies ranging from 260 to 3300 Ilz), 
and log-converting the result (see Nickerson, et al. , 1974). 



46^ 



Report No. 2902 



Bolt Deranek and Newiunn Inc. 



ACKNOv:i.i;Dcu:r':i;:NTS 

ScWral peopJc coDtributod to the progranuning and data 
gathering acpect:3 of this study. The ar.yistance of the following 
individuals is gratefully acknowledged: Robb Adams, Patricia 
Archambault, Dorothy Boothroyd , Douglas Dodds , Barbara Frcenum, 
Daniel Kalikow, Stephanie Shambron, and Robert Storm. The initial 
planning and performance of the work benefitted from the advice 
and guidance of Lois Elliott. 

This work was supported by the U.S. Office of Education, 
Media Services and Captioned Films Branch of the Bureau of 
Education for the Handicapped, under Contract No. OEC-0-71- 
4670 (615) . 



Report No, 2902 



no It noranek and Newman Inc 



hdiuns, M. E. • Tliu ii»tclli<-jiLiUty of the speech of the de<if. 

^^il9.Ci9^1!}_.'}lil?>lI{i_9?„tl^^^ 1914, 59, 451-4G0. 

Brohm, F. E. Speech correction. ^^!:ic9.{I_AnnalG_of _thG Deaf, 

1922, G7, 361-370. 
Bradford, L. J., Brooks, A. R. , and Sliolton, R. L. Clinical 

judgments of hypornasality in cleft palate cMldren. Cleft 

E^l?L^i?_'Z9.Vlt^l?A' 1964, 1, 329-335. 
Colton, R. H. and Cooker, H. S. Perceived nasality in the speech 

of the deaf. ^OE?^!i^l_oL.^E^_^^ll_'l!ll Jifl5:^i?ig„r^^^ 196 8, 

11, 553-559. 

Delattre, P, C. Two acoustic correlates of nasality studied by 

synthesis. Paper read before the Modern Language Association, 

Chicago, Illinois, December 27, 1955. 
Fletcher, S. G. Theory and instrumentation for quantitative 

measurement of nasality. Clef t_Pala to_Journcil , 1970, 7, 

601-609. 

Fujimura, 0. Spectra of nasalized vov^cls. Quarterly Progress 
Report, Research Laboratory of Electronics, Massachusetts 
Institute of Technology, July 15, 1960, 214-218. 

Holbrook, A. and Crawford, G. H. Modification of speech behavior 
of the deaf (hypernasality) . Paper presented to Conference of 
Executives of /American Schools for the Deaf, St. Augustine, 
Florida, April, 1970. 



Report; 14 o. 29 02 



Bolt Boranuk and Newman Inc. 



House, A. S. and Stevens, K. N. Analog studios of the iiaya.! i -at ion 
21, 21fi-232. 

Hudgins, C. V. A comparative study of the spcoch coordination of 
deaf and normal subjects. ^OH£ri{*I_9i_^^"<^tic PKyc'hoIooY^, 1934 , 
LXIV, 3. 

Hudgins, C. V. A method of appraising the speech of the deaf. 
The Volta Review, 1949, 51 (12), 597-GOl, 638. 

Lubker, J. F. and Moll, K. L. Simultaneous oral-nasal air flow 
measurements and cinef luorographic observations during speech 
. production. Clef t J2^1atc_Journal , 1965, 2, 257-272. 

Magner, N. A speech intelligibility test for deaf children. 
Clarke School for the Dr.?f, Northair.pton , Mass., 1972. 

Nickerson, R. S. and Stevens, K. N. Teaching speech to the doaf: 
Can a computer lielp? I5iI;i5i_^ransactionG_^ and 
EL9.9.t£.^^^2liitl9.5.' 1973, AU-21 , 4 4 5-4 55. 

Nickerson, R. S. , Kalikow, D. N. , and Stevens, K. N. A computer- 
based system of speech-training aids for the deaf: A progress 
report. BBN Report No. 2901, Sept. 1974 to U.S. Office of 
Education under Contract No. OEC-0-71-4G70 (C15) . 

Quiglcy, L. F. , Shiere, F. R. , Webster, R. C. , and Cobb, C. M. 
Measuring palatopharyngeal competence with the nasal 
anemometer. Cleft Palate Journal, 1964, 1, 304-313. 



ERIC 



Report No. 29 02 



Bolt Koranok and Nev:man Inc. 



Shclton, R. L. , Knox, A. W. , Arndt, W. B. , and riburt, M. 

Tlio rolal-.ioiir.hi j> Lcl v/ofn ru\?-.;l.lty ncoro valiioj; and oral, cuv.l 
nasal sound prens-ure level. Journal of .••'^Xfoch and llcnr.inq 
Research, 1967, 10. 542-548. 
Stcvonr., K. N., Kalikow, D. N. , and V;illciaain , T. R. The use 
of a miniature accelcrojnc tor for dct-ceting glottal waveforms 
and nasality. BBN Kcport No. 2907, Sept. 1974 to U.S. Office 
of Education under Contract No. OEC-0-71-4670 (015) . 



ERIC 



